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ABSTRACT a Meet t ,.: ; 
— Preparing paucational and riviniis Consultants 

(PECT-II) isthe second in a~-series of three cumulative and 
sequential instructional. systems designed ‘to help a.cadre of. 
educators acquire process tYraining and consulting skills. The PETC-II 
graduate should be capable of forming a temporary relationship with a 
spall areee or major subsystea ‘of an educational organization to help 
it maké progress toward itg goals. The consultant helps’ by diagnosing. 
the client's problems and providing assistande that will téwporarily 2 
add or strengthen such functions as managing, planning and validation: 
which allow the group to more adequately accomplish its immediate- 
goals. Currently the PETC-II consultant.is expected to help the 
Client “become more effective in jointly selected group ‘processes. _ 
ae report-is a summary of the Field Test and Gutcome Milestone . 

pe are for Preparing Educational Training Consultants: Consulting 

TC-II), pfepared by the Improving Teaching Ccmpeténcies Prograa. 
erect) of the Northwest Regional Educational Laboratory (NWREL). It 
provides a summary of the results,of five evaluation activities: (1) 
workshop. evaluatzons, (2) consulting case studies, (3) internal 
summative reviews, (4) an alternative search, and (5) a aneeey of ;* 
potential users. (Author/DEP) é 
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PREFACE 


® ——— 


‘This publication is one of a series of summary evaluation reports 


pes the Northwest Regional Educational Laboratory to document 


evalvation findings for selected products. The subject of thts report 


. 


is Preparing Educational Training Conaultante: Consulting (PETC-II), 


an instructional: system developed in the Improving Teaching Competencies 
' ® 


Program. 


‘Thig summary report presents the methods and results of the field 


test and outcome milestone evaluations. 
- 


. 
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INTRODUCTION . 


The following is a summary of the Field Test and Outcome Milestone 


Report for Preparing Educational Training Consultants: Consulting 


(perc-11),! prepared by’the Improving Teaching Competencies Program (ITCP) 


of the Northwest Regional Educational Lahoratory (NWREL). This»report 
provides a summary of the results of five evaluation activities: (a) 
workshop evaluations, (b) consulting case studies, (c) teceaal summative 
reviews, (d) an alternatives search and (e) a survey of potential users. 
The reader is referred ta the full technical -veport fon a detailed 
description of the methodology and results of each of the evaluation 


activities. : . ‘ ‘ ; * 


PETC-II is the second in a series gf three cumulative and sequential 
ingecueetonal systems designed to help a cadre of educators acquire pro- 
cess training and consulting skills. The PETC-II sedis should be 
capable of forming a temporary relationship with a small group or major 
subsystem of an educational organization to help it make progress Souaed 

ry its goals. The consultant helps by diagnosing si client's problems and 
" providing assistance that will temporarily add or strengthen such func- 
tions as managing, planning ‘and validating which allow the group to yy ; 


adequately accomplish its immediate goals. Currently the PETC-II con= 


sultant is expected to help the client become more effective in jointly 


\ . 
selected group processes. *e a 


J 


luticzarek’ G., C. George and P. Schmuck. Field Test.and Outcome Mile- 
stone Report for Prepart ducational Training Consultants: Consulting 
(PETC-II). Portland, Oregon\ Northwest Regional Educational Laboratory, 
Improving Teaching Competeycfes Pragram, 1976. 7 


The PETC-II materials consist of a trainee manual, a4 trainer's minpay ; 
~ ~ 


and a set of grientation. papers which introduce the system and outline 
procedures for the installation of a PETC-II workshop. The trainee manual 
includes theory papers, dia nostic instruments and inpecaeetans for the 
learning activities, ‘The rainer's manual ‘is a-set of the trainee . 
materials interspersed with detailed directions for conducting the eleven: 
sessions of a PETC-II workshop. 

A PETC-II votkubep is divided into three parts, the first consisting 
of three consecutive 10-hour days of instruction in basic Sen ceuee of 
consulting. The second part is a 3-day practicum ih which trainees 
engage in consulting projects with prearranged client systems. The train- 


\ 


‘ing concludes with three days of debriefing, evaluation of the consulting 


practicum and integrating learnings of the workshop. A typical workshop 


consists of from 12 to 18 trainees and 2 trainers. { 


EVALUATION ACTIVITIES 
Workshop Evaluations 

Three field test workshops (two in Seattle, Washington, and ag de 
Fairfax, Virginia) were conducted to obtain participant judgments of the 
efficacy of the instructional materials under field. conditions. 

The eciie boone were recruited under the direction of the ITCP's 
Office of Field Relations and Dissemination. gIn Seattle fliers describing 
the overall training sioatun were circulated through the district and 
quotas were set for various subsystems in the district. Approximately 
110 applications were receiwed. A committee was formed to determine 
selection criteria and to make the final selection of 70 participants to 
begin the program. Of these 70, 50 were expected to complete PETC-I, 25 
were expected to complete PETC-II and 20 would complete PETC-III. Two 


\ - 
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PETC-II workshops were conducted with nine ily ok in the first 


(Seattle A) and 10 participants in bie ameond (Seattle B). 

In fairfax the superintendents’ staff members personally selected a 
given number of candidates from their staff to form a cadre of 24 parti- 
cipants who,;would complete the entire Providing Organizational *bevelopment 


, 


PETC-III and their prerequisite systems.) The selection criteria called 


Skills (PODS) program. (The PODS program includes PETC-I, PETC-II, 


for staff members who: (a) already performed training and consulting 
tasks on‘ their*jobs, (b) could provide released time to be trained and 

to train others and (c) were the primary decision makers concerning staff 
development. 

"Biographical information collected from the participants indicated 
that the two Seattle workshops were composed pujmarily of counselors, 
social workers and psychologists. The Fairfax workshop consisted of six 
administrators and four counselor/psychologists. The educational back- 


ground and age were similar for allthree workshops. Participants from the 
{ . 


Seattle A workshop reported less previous consulting experience than the 


Seattle B and Faidfax participants. 


\ 


To recruit the practicum client groups in Seattle, the workshop 
installer danied letters to 13 educator groups and 12 citizen groups who 
were working with the district on human service concerns. \ ae the 
installer met with interested groups, three educator groups were selected 
as Seattle A's practicum clients and three citizen groups as Seattle B's 
practicum clients. 

In fatetex the aceite contacted groups with which he was familiar 
as well as potential aend groups suggested by others. Most of the 
groups indicated interest and five were selected. ¥ 
. 

9 SI 


Consujtation Case Studies 

Followup interviews of participants at the three field test.sites 
and two of the interim sites (Portland and Eastern Washington) were con- 
ducted during June 1975. The elasped time since the PETC-II training 
varied from 7 months at Fairfax to 20 months at Portland. Information 


was collected regarding the amount and nature of consulting “done since 


training, participant perceptions of the usefulness of the training, as 


well as participant judgments of the appropesavanana of the workshop 


‘content and strategies. Additidnally, information was collected to 


determine self-evaluation of participant consulting ability. 


t 
Summative Review me 


A summative neerre was conducted for four days at the Northwest 
Regional Educational Laboratory. The four reviewers selected were . 
Gene Mulcahy, Trustee of the Knox Foundation and former Birect¢ of Shanti 
School, Hartford, Connecticut; Ann Burr, elementary pide rere and 
_ member of the Cadre of Organizational Communication Consultants, Eugene 
Public Schools, Eugene, Oregon; Bunyan Bryant, ,Assietant Professor, School 
of Natural Résources', University of Michigan and former ma of the > 
Educational Change Team, Ann Arbor, Michigan; and Bonard Wilson, con- 
sultant with iva Leadership Institute of Spokane and former UNESCO 
Consultant to the Ministry of Education, Indonesia, Rhodesia, Panama and 

i ’ 

the Phillipines. The reviewers were asked to write a critique Of the 
PETC instructional system that addressed the following items: rationale 


and goals, target populations, content, instructional procedures, trainer 


role and potential Gide effects. k 


Alternatives Search 


A search was conducted to identify and describe alternatives to the 


’ 


PETC training in consulting and organizational development. Over 100 
letters requesting information were mailed to people and institutions 
associated with process consulting and organizational development. This 
process identified 35 instructional systems, of which 12 were judged to 
be similar to PETC. These 12 systems were then ‘compared with PETC's /( 
“garget population, training content, instructional procedures, expected 


1 
outcomes, trainers and dissemination. { 


Survey of Potential Users 6 

The survey of potential users asked members of se target obpulation 
the extent to which they believe an educational need exists for PETC 
skills, as well as their personal interest in PETC training. The survey 
was mailed to a random sample of, 264 educators with staff development 
Bae state departments gh education or public school districts. 


BY 
ee this sample, 190 questionnaires were returned, a return rate of 38 


percent. 


RESULTS : rs 


ee? j « 
ae ‘ 
The results of the five evaluation activities have been summarized 
> 


~ . 


and are organized into the major aspects of the instructional system 


. * 
that were evaluated: (a) need or justification, (b) rationale, goals 


and objectives, (c) training content, (d) instructional procedures, 


(e).. training effectiveness and (£) participant satisfaction. 


NEED OR JUSTIFICATION 


Due to the 38 percent return rate for the survey of potential users, 
the results were not statistically generalizable to the total population. ‘ 
Respondents be the survey of potential users, however, indicated they 
considered staff development puiceaaas addressed by PZTC to be fopov tant : . 
in meeting their personal and program peers It should be noted that 
they considered the traditional staff development functions -as important 
as those functions related to PETC. When provided with a description of 
v PETC, at least 86 percent of the respondents indicated the PETC instruc- 
tionaly system would "perhaps” or Waefindtely" be useful in reaching their 
personal of program goals’for staff development. Of the réspondents, 
72 percent indicated they believed there was definitely a need in ak 
educatipnal -community for educators with group process consulting abilities. 
The figld test participants nienitead with this judgment; 86 percent : 
j indicated a “definitely strong need" and 14 percent indicated "probably 
some need" for such training. The cost and timé factors stoene to pose 
potential problems for the installation of P¥TC. Of the respondents, 47 


percent indicated their program might pay fhe cost in time and money of 


PETC training. Only 18 percent, however, believed their program would 


allow-two weeks or more for PETC training. Some participants (43 percent) 


12 . | / 


indicated they, personally, would allow two weeks or more. A personal 


‘interest in attending a workshop such as PETC was indicated by- 66 percent 


of the respondents. ” ' ; 
The alternatives search identified ‘12 instructional systems that 
: were ‘judged to be serious alternatives to the PETC series (PETO-T, PETC-II 
and PETC-III). “Of ‘the 12 alternative Programs, 3 are described’ as having 
a target population comparable to PETC's. The alternatives aeadck indi- 
cated there are definitely training systems in use which are simtige 
aidiot < complementary .to the PETCs and their prerequisites in at least 


some of the consent and. strategies. While many appeared td contain ‘some 


material not in the PETCs, none seem to contain most of what is in PETC-I 


‘ 


or in a significant part of PETC-III. Much of the content of the 


identified, alternatives appeared more descriptive of the prerequisite ~ 


systems than the PETC series. 


RATIONALE, GOALS AND OBJECTIVES f . . 


‘The workshop particlpante evaluated the goals and objectives highly 
‘N 


as to their dlattiy and Japortances Clarity was rated good or excellent. 
. 
by all but one participant, and the importance of the goals was rated - 
good or excellent by’all of the participants. 


The four summative reviewers were also generally positive in. their 

; ‘ : 
~ evaluation offthe rationale, goals and opjectives. The summative reviewers 
based their evaluation on an examination of the workshop materials and 


‘ 


—_ 


supporting ‘documents,.’ Three of the four reviewers felt the goals and 


a ld! were clearly stated. All reviewers thought the claims and, 


‘ fe 
disclainer’ in the system were clase and well stated. The broad goal of 


C, to improve the éepuateadtonds effectiveness of educational systems 


by preparing educational training consultants, was considered socially 


Beat Fae: : 13 


‘ 
—~, 
. 


eiguiticanh: However, the reviews vata four aa Justice concerns. 
j ' ‘The first concern related to the eatvet population. for PETC. Reviewers , 
, felt the exclusion of individuals not able to sey for the fraining either ‘ 
in dollars or time implicitly reinforced a process of race and sex 
. differentiation. The second concern related to the ety vain stance \ - ; 
of PETC in relation to.social, justice issues. A suggestion was made that 
i an additional pac » such as the ITCP's Social Conflict and Negottative 
: Problem Solving, be constructed to directly deal with problems of social — 
justice. A third concern related to sexist and racist implications. | 
The use of sexist language was pointed out by all the reviewers. The 
final concern was the potential "misuse" of PETC training. One reviewer 


stated that “although well intended, the PETC programs may set the con- 


ceptual or theoretical framework for skillfully supporting or maintadning 


. deep-seated cultural patterns." 


oe , ) 

TRAIN{NG CONTENT os 7 : . 
a field test participants evaluated the training content on the 

final questionnaire. The workshop materials were rated positively on 

the criteria of clarity (54 percent of the participants gave a positive 

rating), interest (82 percent rated as positive), ead of demialink 

original thinking (68 percent rated as positive). None of the ae cataat : 

rated the workshop content below satisfactory on the 2... of: 


‘ a a: YY 
appropriateness, gelevance, clarity, parsimony and .prdctical significance. 
. : j 
The major conceptual models employed in the system were rated positively 
as to their clarity and utility. » Additionally, the preworkshop orienta- 


tion mateesets were rated positively in terms of providing the informa- 


. . 


i. . : - 
tion needed by participants as well a$ giving them clear and correct ~ » 
f co oh | ’ 
expectations. | a : ‘ 
- s! : 1 4 ‘ : . 9 


= : * . . s ¢ ’ 


On the training logs and in their conversations with the evaluators, 


none of the’workshop trainers reported any mafor content problems. 
. ' 
Overall, the summative. reviewers rated the training content posi- 
. * e 
tively. Each reviewer made some specific criticisms and recommendations, 


. 
. 


but no general agreement was reached on them. 


“INSTRUCTIONAL PROCEDURES 

The field test participants positively evaluated the workshop stock: 
"dures according to the detuaving evioucla: At least percent of the 
payticipants thought the siuteeteus Wark good or‘excellent in their 
wipeopedacatioan and usefulness fpr learning consulting skills. The pro- 


. 


cedures were rated good or excellent in the effictent use of time. The 
ae eo: : 
value of the practice exercises and the usefulness of the training struc- 
ture were rated high by 86 percent of the participants, as was the amount 


of time provided for reflection and personal growth (also rated highly 


by 86 percent of the participants). 


The workshop installers indicated in an interview they thought the 


workshop procedures were feasible for the recruiting of participants and 
practicum clients. They reported the recruitment information and 


installation guidelines were useful. 


The trainers reported the directions for each session were adequate. 
‘ 
No major problems or modifications of the workshop design were reported 


+ 


on the trainer logs. Some problems were reported concerning the workshop 


‘environment and interpersonal issues of participants. 
The summative reviewers, from an examination of the trainer's 


manuals, sated the workshop procedures positively. Specific criticisms 


’ 


were made. by each reviewer but there was no general agreement on them, 2 
4 . 7 ’ al F 


TRAINING EFFECTIVENESS ’ 


«Three kinds of information pertaining ta. training effectiveness were 


collected: (a) participant and client perceptions,of the value of the 


° 


workshop practicum, (b) ‘the amount and nature of the consulting: done. by 


2 or 


PETC-II graduates and (c) self-ratings by PETC graduates of their 


consulting competence. 


* On the final questionnaire the participants thought the practigum 


was a valuable experience; 93 percent checked 5 ot 6 ona 6-point ,anchored 


contributing to their Ketstaccion were the experience provided by ang 
. < $ 


rating scale with % the high point. The most frequently: listed factors 


practicum and the opportunity to practice consulting skills. 
’ . 


All but one of the practicum clients indicated they were satisfied 


‘ 


rs 
with ther consulting provided by ae PETC participants; 23 of the 42 were 
ores pleased" wish the ‘consulting ‘exverfence. Of the practicum clients, 
37 of 40 felt the eonwcttial expérierice was helpful; 3 felt the éxperi- 
ence was of little help to them. All but 2 of the’ practicum clients 


responding to the practicum client questionnaire were able to identify 


bile 4 


a specific change they intended to make ag a result of the eanining 
experience. 7 

Information was collected on the amount and kind of consulting done © 
by PETC-II. graduates. _Of the 41 graduates interviewed, 25 had coupiated 


further consulting since the workshop. ~ The amount of consulting ranged 


. from one time to twenty-five to thirty times. Of those who had consulted, 


fo: half consulted less than five times. An analysis was done of the 
amount of consulting after training of those with no prior consulting 
experience! Of the nine respondents who indicated they had no prior 


consulting experience, five, had consulted after training, four had not. 


xs * 416 


An analysis of. the effect of one's professional role on the amount of 


ee done indicated fhat for this sample, administrators were more 


’ 


: Hibety to consult Shey eepadaintateatars: Information collected ona < 
ea Ld interview tndicgred the consulting graduates worked on a wide - 
range of client probleng ahd’ goals, as was expected.» Of the 33 con- 
sultants reported, 13 favoived the* goneultant’s planning or conducting 
a mebinhop or training, The graduates perceived their consultations as 
felpful to the client) groups in solying their.problens. ,Of those that 
had not ‘ects the most E Evaquenk sy listed reasons for not’ sOnseLENUS 2 
were: insuffitcient /time te 5 ehindaliee Shade, Feoeeseronal role did not 
include the possibility of consulting and no one had raruastad consulting 


help. All but: one é the respondents to a followup interview indicated 
that they had planned to Pd consulting in the future. 

All fie ns the respondents indicated they had used dhe teaindee 
in less formal ways than actual consulting. These included: identifying 
areas of heeded o ganizational change; helping a group develop a program 
or organization flor meeting a goal; organizing and planning own efforts 
to help a group; helping own group shesueh a change process; and helping 
someone yitlevetend tf potentially destructive experience in a group or 
organization as part of a counseling satleale: 

The consulting skills of the PETC-II participants were evaluated by 
thenselves as well as by the practicum clients. .On the practicum client 
questionnaire, all but one. of the respondents rated the consultants as 
generally competent in areas where help was needed. Additionally, the 
self-ratings of PETC-II graduate ability were positive with méan responses 
of 1.46 to 2.58. (These-were rated on a 5-point anchored eating scale 
with 1, excellent ability and 5, unsatisfactory ability. The respondents 


’ . 
. 


12 


rated themselves most capable of building a helping relationship, identi- 

, ‘4 . ‘ en — : , 
fying alternative solution strategies, and understanding group. processes 
¢ * ° . . 


‘ 


? . 5 


and problems. Respondents rated themselves lowest on the abilities to 
help build motivation to change, hekp the group generalize and stabilize 


Se ° ° 
their change, and help the group evaluate the change and the.change effort. | 


: ‘ 
‘PARTICIPANT SATISFACTION " 
v bY) _ 


\ 
On the final questionnaire, 7 of the 


4 ‘ ; raed 
9 participants at Seattle A 


and all of the participants at Seattle B and Fairfax fresy vhe workshop 


as worthwhile. The positive perceptions were maintained over time with . 
"sit ut ‘one of the Kphtenlnatiy on the followup a eye rating. the work- 

’ shop’ as dertiwhihle and half of ‘the respondents judging it extremely 
worthwhiie. Of the saceictvante, 66 jaisenk duddcated that the workshop 


‘ met their expectations. ‘The participants rated the workshop positively 
> ; a 


ey compared to other professional education courses. On the final question" 
aC ey ie 
naire, 24 of the respondents felt the costs in time and:money were small 


: for the outcomes, 2 respondents felt the costs were about right. On the 


J 
* 


followup interview, 17 respondents felt the costs were small for the’ 


outcomes; 5 felt the costs were about right for the outcomes. 


